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Introduction 


The  symptoms  of  TBI  (which  often  are  accompanied  by  post-traumatic  stress  disorder)  include 
disturbances  in  attention  and  memory,  as  well  as  impaired  cognitive  processing.  Often  the  most 
troubling  symptoms  are  behavioral:  mood  changes,  depression,  anxiety,  impulsiveness,  and 
emotional  outbursts.  Intolerance  of  crowds  and  hyper-vigilance  are  also  common.  Behavioral 
therapy,  a  mainstay  of  rehabilitation  treatment,  generally  requires  that  veterans  be  able  to 
organize  and  negotiate  daily  activities  and  interact  with  the  general  public  to  meet  scheduled 
appointments,  stressing  the  very  areas  where  many  are  profoundly  impaired.  New  therapeutic 
options  that  can  be  delivered  to  veterans  at  home,  and  that  can  augment  current  processes  are 
needed.  Fortunately,  virtual  world  environments  (VWEs)  hold  the  potential  to  answer  these 
concerns.  VWEs  are  easily  accessible,  intuitive,  and  effective  forms  of  virtual  reality  that  provide 
secure  real-time  interaction  between  multiple  users.  Many  younger  warriors  are  not  only  familiar 
with,  but  comfortable  and  fluent  in  virtual  realities  through  their  exposure  to  electronic  gaming. 
The  goal  of  this  concept  award  was  to  1 )  build  working  teams  of  clinicians  and  computer  experts 
to  collaborate  to  conceptualize  a  relevant,  therapeutic  VWE  for  returning  combat  veterans.  2) 
Construct  a  working  prototype  VWE  that  could  be  occupied  by  a  therapist  and  patient 
simultaneously. 

Body 

The  goals  of  this  proof-of-concept  award  was  to  develop  a  working  prototype  of  a  VWE  that 
could  augment  traditional  cognitive  therapy  for  combat  veterans  with  mTBI.  To  accomplish  this, 
we  used  the  principles  articulated  by  Bisgaard,  lansiti,  Menon  and  Hippel  et  al 1-4  to  assemble  an 
interdisciplinary  group  of  investigators  with  broad  clinical  and  technical  expertise  to  engage  in 
an  iterative  and  recursive  process  to  develop  our  prototype  VWE. 

1)  Teams:  We  assembled  a  working  group  composed  of  three  physiatrists,  one  physical 
therapist,  two  neuropsychologists,  a  psychologist,  an  advanced  nurse  practitioner,  an  arts-in- 
medicine  specialist,  a  digital  media  artist,  two  graduate  assistants,  and  a  technical  director. 

2)  Process:  We  divided  our  group  into  two  teams  and  added  an  advisory  panel.  Our 
multidisciplinary  clinical  team  (CT)  was  made  up  of  our  clinician  investigators,  with  each 
member  actively  engaged  in  evaluating  and  treating  combat  veterans  from  Operation  Enduring 
Freedom  (Afghanistan)/Operation  Iraqi  Freedom;  Our  Technology  Team  (TT),  was  comprised  of 
the  remaining  members,  all  of  whom  had  experience  creating  VWE  for  therapeutic  purposes. 
The  advisory  Panel  was  made  up  of  national  experts  in  VR,  telehealth,  and  mental  health. 

In  the  first  2  months,  the  CT  met  with  the  TT  three  times  to  establish  overall  project  goals,  and 
to  establish  the  roles  and  responsibilities  of  each  team.  During  this  period,  the  CT  briefed  the 
TT  on  the  problems  facing  returning  combat  veterans  with  mTBI,  and  the  TT  discussed  and 
demonstrated  the  capacities  of  the  Digital  Worlds  Institute  and  VWEs.  Following  this  initial 
period,  The  CT  began  meeting  twice  a  month  to  brainstorm  how  the  VWEs  might  be  developed 
to  help  in  the  rehabilitation  of  mTBI.  The  CT  then  would  brief  the  TT  every  4-6  weeks.  With  the 
input  of  the  TT,  the  clinical  team  was  able  to  sharpen  and  focus  its  vision  to  imagine  scenarios 
that  would  take  advantage  of  the  unique  capacities  of  VWEs,  and  that  were  realistic  given  the 
time  and  resources  allocated  to  the  TT. 

The  CT  considered  three  promising  scenarios.  A  grocery  store  that  could  offer  computational, 
navigational,  and  memory  challenges,  and  a  home  environment  that  would  involve  planning  for 
the  day  and  travel  through  an  urban  environment,  were  considered.  A  different  type  of  scenario, 
a  “build-it-yourself  “  virtual  Iraq  that  would  challenge  veterans  to  remember  and  process  their 
wartime  experiences  while  teaching  them  design  and  computer  skills  that  might  be  useful 
vocationally  was  also  considered.  With  the  help  of  the  TT,  the  “build-it-yourself  scenario  was 
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judged  to  be  both  impractical  and  somewhat  duplicative  of  existing  VR  applications.  The 
grocery  store  was  ultimately  preferred  to  the  home  environment  because  it  was  felt  to  be  a 
common  environment,  which  could  easily  present  multiple  levels  and  types  of  cognitive  tasks 
and  emotional  challenges  that  are  often  vexing  to  those  with  mTBI/PTSD.  The  home  scenario 
was  felt  to  be  harder  to  standardize  and  was  felt  to  have  less  flexibility 

Through  this  process,  the  following  work  plan  emerged: 

1)  Build  the  virtual  grocery  environment  starting  with  floor,  walls,  and  empty  shelves 

2)  Fill  the  shelves  with  items  and  decorate  the  environment  in  consistent  with  a  grocery 

store 

3)  Build  a  functioning  aisle,  with  a  variety  of  grocery  items  that  can  be  selected 

3)  Build  avatars  that  can  be  “inhabited”  by  therapists  and  patients,  and  directed  by 
joystick  control 

4)  Equip  the  avatars  with  grocery  carts  into  which  selected  items  can  be  placed 

5)  Create  a  variable  number  of  “bots”  (animated  people  who  roam  the  store 
autonomously) 

6)  Create  a  virtual  wallet  which  can  be  filled  with  a  variable  amount  of  money  as 
determined  by  the  therapist. 

7)  Create  ambient  noise  that  can  be  either  increased  or  decreased  at  the  therapist’s 
discretion 

8)  Create  a  collision  between  shopping  carts.  Allow  this  to  be  either  minor  or  major 

9)  Allow  the  therapist  to  switch  between  different  avatars  such  as  a  shopper  or  a  cashier, 
depending  on  the  therapeutic  scenario. 


At  of  these  goals  have  been  met  (Figure  1 ).  In  addition,  the  AP  has  also  met  to  evaluate  the 
progress  to  date  and  give  further  suggestions.  Currently  they  are  satisfied  with  the  direction  and 
progress  to  date,  and  urge  us  to  seek  further  funding  to  continue  our  work. 


Figure  la:  Two  avatars  shopping 


Figure  1  b:  An  aisle  of  the  store. 


Key  Research  Accomplishments 

•  Development  of  an  iterative  team  structure  that  allowed  trans  disciplinary 
conceptualization  and  implementation  of  a  prototype  virtual  grocery  store. 

•  Construction  of  a  prototype  VWE  that  allows 

o  The  therapist  and  veteran  to  traverse  the  grocery  store  together  each  occupying 
distinct  avatars 

o  The  therapist  to  switch  to  a  third  avatar,  the  cashier 
o  The  therapist  to  set  parameters  such  as: 

■  Money  in  a  virtual  wallet, 

■  Number  of  other  autonomous  avatar  shoppers, 

■  Ambient  noise  level 

■  Collision  with  another  shopper. 
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Reportable  Outcomes 

Presentations:  Levy  CE,  Oliverio  J,  Sonke  J,  Hundersmarck  T,  Demory  J,  Tassin  C,  Sinclair  A, 
Scott-Okafor  H,  Omura  D 

Virtual  Environments  for  Cognitive  and  Affective  Dysfunction  in  Mild  Traumatic  Brain  Injury  and 
Post-Traumatic  Stress  Disorder:  Development  of  a  21st  Century  Treatment  Platform.  Military 
Health  Research  Forum  (MHRF)  Kansas  City,  Missouri,  9.09 

Letter  of  intent  to  CDMRP:  PT090225  Virtual  Environments  and  Virtual  Humans  for  TBI  and 
PTSD:  Status:  Not  accepted  PICharles  E.  Levy,  MD 

Letter  of  Intent  to  DMRDP:  Assessment  of  Executive  Functioning  Domains  in  3  Ecologically 
Valid  Modalities:  Principal  Investigator:  Tatjiana  Novakovic-Agopian,  PhD.  Co-PI:  Charles  E. 
Levy,  MD  Submitted  9.09 

VA  RR&D:  1 101 RX000339-01  Virtual  Environments  for  Therapeutic  Solutions  (VETS) 
mTBI/PTSD  Phase  II:  Submitted  6.09.  PI:  Charles  E.  Levy,  MD  Status:  Pending 

Conclusion 

We  have  successfully  built  and  demonstrated  a  VWE  prototype  with  a  host  of  features  deemed 
relevant  by  clinicians  treating  returning  combat  veterans  with  PTSD/TBI.  The  next  steps  would 
be  further  development,  refinement,  clinical  trials  and  technical  transfer. 
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